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ABSTRACT ' . ^ 

This report reviews the maj.or lines of investigaCtion . 
of the KamehamehaVEarly Education Program (KEEP) for the period 
1971-75. A brief introductory section describes the selection bf 
initi^il, research strategies, identification of problems, issues In 
research design (such as internal versus external validity) and 
problems pertaining to the process of translating theoretical 
research into classroom practice. A major portion o£ the report 
focuses on a discussion of KEEP's four major lines of research: 
student industriousness, linguistics, rekding, and staff 
training/consultation. Additional areas of KEEP research are briefly 
sumifiarized and include culture and family research, evaluative and 
outcome research, and an account of cooperative research efforts with 
inifestigators from other institutions. (CM) 
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TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC) AND 
USERS OF THE ERIC SYSTEM." 



The, Kamehameha Early Education Program 




The Kamehameha Early Education ProgramM^K^ Is a research and 
development program of The Kamehameha Schools/Bernipe P. Bishop Estate* 
The mission' of KEEP Is the development, demonstration, and dissemination 
of methodcj. for Improving the education of Hawaiian and' Part-Hawaiian 
children. These activities are conducted at the Ka Na'l Pond Research 
and Demonstration School, and In. public classrooms In cooperation with 
the State Department of Education. KEEP , projects and activities Involve 
many aspects of the educational process, Including teacher training, 
curriculum development, and child motivation, language, and cognition. 
More detailed descriptions of KEEP's history apid operations are presented 
In Technical Reports #1-4. ^ ^ 



Preface 

" This report reviews the major lines of investigation of the Kamehameha 
Early Educatioh Program' (KEEP) for the period 1971 through Spring, 1975. We 
have written this report for that audience of scientists and protessionals wh'a / 
ar& concerned with the educational problems of minority culture youth. In ' / 
this report, we .present five extensive reviews of research findings; these ^: 



reviews represent matured lines of KEEP research. Work in progress or not 



fully conceptualized is described briefly in the introductory section. , 



Because of preparation and editorial leadtime, work carried out ^n the 

fifth year of KEEP (1975-1976) is not included in this report. "Subtracting 

■ " />;,.... 
the start-up time of one and a half years — which includes construction delays — 

this. report covers two and a half years of research activity .^^ / 

During this two and a half yea^r period, we have pursued /four major lines 

'\ / . - ■ • 

of research. They are: reading, linguistics, student industriousness , and 

j 

teacher training/consultation. Findings related to^ each/of these areas are 
reviewed in detail in accompanying reports. Futher details on particular inves- 
tigations ara available in the approximately 65 KEEI? Technical Reports and 

working papers (a current list'of Technical Reports and working papers is pre- ^ 

/ ' 
sented in Appendix A) . . ' / v 

» ■' , ' 

In addition to this review of research, we have also prepared a summary of 
KEEP research for a broader audienpe. This^ summary is an unelaborated state-' 
ment of major KEEP activities and findings; of 'necessity, it ^oversimplifies 
since it condenses to a few pages* what, is presented heyre in dozens of pages. 

There are many people to whom we^are grateful. We thank them all for their 

support and assistance — the ones at the Kamehameha Schools/Bernice P. Bishop. 

■ . . . /' * ■ 

Estate, the University of f alifornia, Los Angeles ,^,the Department of Education, the 
University of Hawaii, and, most especially, the people at KEEP who made it work. 
Ronald Gallimore . ^ , ^ 

Rolgnd G. Tharp ^ . ' . » 

, ■ • • . . ' 4 . ' 



Technical Report #66 

An Overview of i ' 

Research Strategies and Findings *^ . 

a ' 1971-1975 

of the Kamehameha Early Education Program 
Ronald Galllmore . Roland G. Tharp 

KEEP was established to research and develop effective ways to teach 
Hawaiian-American children fundamental educational skills. The means was to be 
a research organization capable of simultaneously following several lines of 
investigation. KEEP is a multifaceted program of research and develof)ment^, 

a- 

rather than a project; it w^s designed to carry on many investigations, not to 
test the relative value of a preselected^ approach. 

The selection of a programmatic research and development strategy was 
jointly shaped by national and Island experienceSg In the early 1970s, the 
nation discovered that large sums of money, enthusiasm, and imaginative program 
ming alone would not solve the educational problems of minority culture yputh. 
In Hawaii, the State Department of Education experimented witfc innovatiye 
programs, keeping in step with national treads, and, at times, showing the w^y. 

) ■ ■ . ; : 

Headstart, Follow Thtough, compensatoxy programs, and TESOL, among other^ . 
approaches, were tried and were evaluated as. often helpful, sometimes necessary 
but not/suf f icient 

We (Concluded that, in Hawaii, there was a nee/ for sustained, fine-grained 
5is of the educational process (Th^rp & Galllmore, Technical Report. #3)./ 
m if a particular prograih worked or produced gains, the r'feasons were not 
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always clear, thus making any transfer to other settings difficult . With the 
establishment of KEEP, we hoped to separate fact from wish, to balance program 
enthusiasm With understanding, and to define the necessary and sufficient 
conditions for Hawaiian-American student achievement. To do this, it was 
clear that a single project or investigation would not succeed; a long-term 
sustained effort would be necessary. 

In addition toj developing ways to educate, a founding goal of KEEP was the 
discovery of effective means to communicate the findings of research to public 
school teachers. It was this goal that led to the' KEEP relationship with 
Hawaii public schools and the KEEP consultation/dissemination research pro- 
gram, and the definition of the KEEP school as a demonstration, as w,ell as _ 
a research, center. ^ . , 

We have attempted Ct^KEEP to Create an externally valid setting in which 
to pursue several lines of internally valid research. The external population 
for "which we seek valid findings are the Island children who experience 
difficulty and who are the special concern of The Kamehameha Schools/Bishop 
Esta£e. The external setting is the public school classroom. With pne 
important exception, we have attempted to operate a realistic program, 
respecting the constraints that face public schools now and in the forseeable 

future. . * 

The important exceptipn was the research mechanism that was built around 

and in what was otherwise- a typical public school. The research mechanism 

■ . ) . • ^ • 

was organized to analyze a-nd, as necessary, change the basic public school 

model toward" the goal of effective education of the minority culture child. 

We thought it at l^st possible that with some tinkering the basic public 

school model might work for o\^r target population. Such an outcome would have 

enormous -practical advantages. The goal was to develop arid refine approaches- 
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1 » . ' 

that not only will work in public classrooms, but will have some chance of 

being adopted; that solution which required (the least* change would be the most 

desirable. Therefore, the KEEP model will gradually be defined through a 

series of least-changes necessary to product effective learning. 

Selection of Initial Research Strangles and Problems 

" ' " ■ ' ■ " 

' 

In«1970, when the KEEP jCes^d^arch and development prograih was conceived. 




there was no lack of opinion on what was required to make schools effective 
for minority culture youth.' 'The problem was a lack of facts.. For example, 
although the role of Hawaiian Islands Creole English Xpldgin) has been ^ ^^ 
argued for decades, there were virtually no studies of its specific impact on. 
educational achievement or on the learning process of Islaild children.. Despite 
the absence of facts, there was some interest in radical and expensive dialect- 
related innovations — Creole readers, Standard English drill,, and so forth. 

Those we consulted agreed that the major problems *"for public education 
were student industrioiisness , profound reading retardation, language difficul- 
ties, and teachers who were unprepared for culturally heterogeneous classrooms 
and unruly children. Earlier research in a singl*e community generally confirmed 
these to be l^he problematic areas (GalliAore, Boggs, & .fordan, 1974; Gallimore 

ioward, 1968; and MacDonald & Gallimore, 1971). However, there was no 
agreement on effective solutions. We were advised to review the literature, 
consult experts, weigh the results, and select for each problem area an 
approach or program 'on which to place our bets. In cshort, we should select 
the currently most plausible or popular scheme and give it a one-shot, 

thorough (and expensive) trial. ^ ' ^ 

We rejected this approach. We did not believe then, nor do we now believe 
that anyone's "best guess" at a program is worth the gamble Involved. Millions 
of dollars of the Hawaiian q^ildrens' heritage ia at stake, but also at risk 



is the first opportunity for the Kamehameha Schools/Bishop Estate to make a 
substantial research contribution, to the educational needs of the majority 
of Hawaiian children. In our view, KEEP should emerge as a permanent problem- 
solving resource for Hawaiian education, able to adapt its^focus as social 
conditions change and bring change to educational issues. The first tacfic of 
this unit was to resist making recommendations, resist enthusiasms (even our 
own), until we had gained a thorough, inside~out, data-based knowledge of 

* 

Hawaiian children and their classrooms. 

Thus, we had two related tasks. The .first was to build an organization 
capable of sustained inquiry into tbpics which would vary as widely as do the 
issues affecting Hawaii'an education. The organization had to be built from 
scratch: a building constructed, children .■enrolled, their parents' cooperation 
gained, a staff recruited and trained. This organization had to learn from 
arid to teich its host iixs titution. The Kamehameha Schools/Bishop Estate, how 
to nurture and to benefit ufrom a research operation. Complex aYld .vital 
relationships with the ^tate Department of Education had to be developed and 
smaiatained, 

The second task was to gather the data.v ' . 

The next stage will be to develop specific programs, whose value, can be 

/ i 

demonstrated, which can be exported to the Department of Education, an^ which 
w±ll be so founded on evidence that the gamble of their failure will ^e mini- 
mized. In fact, that program development occupied most of our energies until 
1976, th^ results of which have not been digested In time for.t|^^is report, ^ ^ 
which concentrates on the broad inquiries and findings upon which the eventual 
KEEP recommendations will be based. 

A broad-gauged theoretical and empirical approach has provided several 
advantages. It permits different"* but related lines of invest igatiori: reading, 

o 
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linguistics, student induatriou^ness , and teacher training// consultation, as 
well as explorations in cognitive, cultural, and personality research. V 
Within these' lines of investigation, diversity of theory and method are also ' 
possibly so that different approaches and perspectives can be fpcused on a • 
sin^e prol^lem. For, example, the linguistic research (Gallimore & Tharp, 
Technical Report #59) included two independent researches: 1) the effort' to 
devise measures of Standard English and Hawaiian Islands Creole, and 2) experi- 
mental and developmental studies of Standard English acquisition. These 
''investigations proceeded independently and yet arrived at a final, common 
conclusion. Thus, the credibility of\J:he results is greater. 

By not committing to a single_theor5\ or program, we believe KEEP has been 
more open to new hypotheses and ideas from both external and inte^al sources. 
Even with the approach we took, in a rapidly growing organization, it has ^ 
been difficult to maintain the' openness and flexibility necessary to pursue 
-new ideas and abandon favoirte hypotheses. We imagine it must be nearly 
impossible when ihe task is to prove that the original choices are correct. 

Th^e have t>eeri disadvantages to the broad-gauged approach. The most 
immediate was t'he difficulty of explaining to friends and critics what we 
were about. We described this problem earlier (see Technical Report #4); we 
have never completely solved this public relations difficulty. 

Part of the reason is that we have tried to do something essentially 
different from many people's conception of an education research project, 
^caus^ we operate a school, many visitors expect, us to have a particular 
enthusiasm, an "It", that can be evaluated by student achievement measures. 
In the period covered by this report we had no "It." A school operation 
can be evaluated by the performance of the students, but the KEEP research 
must" be jdug^d ip terms of the quality and quantity of results, of the some 



75 studies tihat have been conducted. We never expected that the value of the 
research could be tested in the short-run by ^outcome achievement measures. 
After all, the initial strategy was to operate an externally valid representa 
"tion of a public school. During KEEP's first years, little could be learned 
about ;Our research by examining student achievement measures sinc^^the school 
represented the best, but limited, range of practices currently in use in 

the- public schools y for example, identical .teaqher-pupil ratio, curriculum, 

' ' • " * 

and so forth (see Technical Report #4). 

Visitors to KEEP still expect . to see the "It,'' the "set" of innovations 
which we adyocate. We still struggle to explain our .broad-gauged approach, 
and the commitment to research. In- future years, what they see will change 
as research informs program. After opr initial years of using the public 
school model, we have begun moving toward a KEEP approach to educate those 
Island children who are the special concern of The Kamehameha Schools/Bishop 
Estate. In some respects, it confirms public school practices; in other ways 
we have discovered refinements and alternatives that appear to be more 
effective, at least -with the populations with^whom we have worked. / 

We have begun to nai/row the, gauge. As KEEP research continues, the 
theories and programs to which the work has led will be changed and refined, 
as were thfeir predecessors. ^ I 

External versus Internal Validity, and the Role, of Qualitative Knowing 
. Perfect research design in behavioral science is rare, perhaps impossible. 
Normall^ an investigator seeks maximum protection against internal validity 
threats, often at considerable cost to external validty. For example, poten- 
tially impbrtant population variables — such' aa ag6, sex, social class,'^to 
name a few — miglit be controlled by elimination in order to achioye an inter- 
nally' valid study of complitfated variables. Detenfi^ning the generalizability 
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(or external validity) of the findings io populations other than those used 
would, of necessity, require^f urther work. Such a strategy has many critics 
who argue that the traditional emphasis oyi internal validity has been costly. * 
The harshest critics regard as trivial the tightly controlled internally valid 
experiments published in journals of psychologic science. 

In practice, researchers place differential importance on internal and 
external validity, depending on their training, personal predilictions , 
research problem, and tihe like. For some time, the trend in psychology Was 
toward increasing internal validity, with little concern for threats to external 
validity (Cronbach, 1975). Recently, dissatisfaction with the result pf this ^ 
trend has led to more interest in field studies, and other alternatives to 

« 

quantitative-experimental social science." ! 

^ .1 

Part of the force behind the renewed interest in externally valid psycho- 
logical research is the recognition that main effects may be an exception in 
human behavior. Unlike the physical sciences , the norm in psychological science 
may be higher order interactions that defy reduction to one set of independent 
variables (C^^bell, in press). This argument will no doubt heat up in coming 
years; whatever".dne*s prejudices , this renewal of the quantitative-qualitative 
argument yields a healthy, stimulating tension in behavioral science. 

This tension has been an important dynamic at KEEP. Many of our conclu- 
sions are significantly influenced by the fact thatVe, as practicing | 
researchers with a. commitment to internally valid designs, have had simultane- 
ous operating responsibility for a "real*' sc>ool. The school has been an 
insistent reminder of external validity issues. ^ 

For elample, one study produced a statistically and theoretically impor*- 
tant correlation between attentiveness to a peer tutor and amount of sibling 
care-taking in the home (see Technical Report #20). The internal validity . 
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was good, the external validity doubtful. In the first place, the -amount 
of .actual difference in child attentiveness was slightly less than 10 percent. 
To achieve this 10 percent increase with children from high'slbcare homes, 
virtually the entire curriculum and most of the school operation would have 
had to be changed. We know from operating a school for five years that 
major changes of any kind have effects that even the wisest observer cannot 
anticipate. The interactions that are produced when an innovation is in- 
stalled are often far more potent than the simple main effect which the study 
revealed. At best, l:he study could support this general statement: In some 
settings, peer tutoring may be an effective teaching tactic, but each situation 
will require careful pre-intervention assessment and planning. 

We could have pursued the peer-tutoring finding with a more intensive 
research effort. Perhaps the initial finding would lead to a wealth of data 
that would justify or illustrate how peer tutoring could be more full inte- 
g'tated into daily instruction. But our other on-going investigations ^and 
experience in operating the school clearly suggested that alternative sources 
of attentiveness were far more significant: teacher skills, child's 
linguistic fluency, and so forth. In these respects, the peer-tutoring 
study had little external validity, for school classroom operation, though 
clearly the obtained correlation^ might be generalizabje to (have external 
validity for) other communities in which sibling cajretaking occurs. 

The interactions which may threaten internal or external validity often • 
defy the most clever efforts at research control. For^xample, one of our 
-studies attempted to compare several teacher-training techniques; teax:hers at 
KEEP, were theVparticipants • ^ We imagined that being the administrators of 
the school and the teachers' immediate authorities would increase the ^egree ' 
of control we could exercise over extraneous variables.. Previous efforts in 
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■public schools had alwaxs be^ troubled by factors related to our minimal 
influence over either teachers or administrators. Every researcher knows 
how evenjfe^ll-intentioned persons may unwittingly compromise an experiment. 
' At KEEP^we had authority r"^fi5^hus could «.rectly instiuct (order) the , 
^teachers to follow the prescribed training routine. Of course, our .unusual 
, degree of .control interacted with staff response to training (Sloat, Tharp, ' 
& pallimbre, Technical Report #41). Enlarging the study to include an 
appropriate control group would have introduced more threats to validity, for 
example, the problem of trainee compliance -with instructions >in schools where 
close monitoring is impossible or resisted, and so forth. This conclusion^ is 
jl^ared by Cronbach (1975) ; The sample size "required for establishing complex 
interactions, at least" in , instructional research; becomes prohibi^t ive" (p. . 124) . 

In- a provocative critique of iixedTCondition experiments which seek to^ 
identify main effects, Cronbach argues that the ^ ^ ^ 

' ' /experimental strategy dominant in psychology since 1950 has only, 
limited ability to detect interactions. Typically, ^ the investi- 
gator delimits^the range of situations considered in his research • 
program by fixing many aspects of the conditions under whicli. -the 
subject is observed. The interactions of any fixed aspect are' 
thereby concealed, being pulled into the.niain effect or into the 
interactions of other variables. The cohie^d interaction may 
even wipe out a real main^effect of the variable.that chiefly con- ' . 

' cerns the investigator . .'..When the system of interest cannot be 
constrained to fit a limited mode;,, t;he» function of research in 
highly standardized conditions Is primarily to identify pertinent 
variables and to suggest possible mechanisms to study in more 
natural situations. (1975:* 123-124) 

Crpnbach's analysis echos bur experience at KEEP. Fixed-condition ex- 
periments (our own and f r^m the "literature) have helped to identify important 
variables to be pursued in the externally valid school we operated.. As he , 
suggests,. 'however, an overreliance on the . fixed-condition paradigm is an. 
unnecessary and regrettable limitatiion to impose on one's research. 

' Cronbach* s suggestions for enlarging the range of accepted research 
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strategies also provide an accurate summary of what we learned at KEEP about 
doing problem-oriented research: * 

From Occam to Lloyd Morgan, the canon has referred to parsi- 
mony In theorizing, not observing. The theorist performs a 
dramatist's function; if a plot with' a few characters yill tell 
the story, it is more satisfying th<^n one ^ with a crowded stage. 
But the observer should be journalist, not a dramatist. To suppress 
a variation that night not recur "lis bad observing. (1975: 124) 

Y t^The time has come to exorcise the null hypothesis. We cannot 
/ afford to pour costly data down the drain whenever effects present 
\ in' the sajnple 'fail to reach significance.' Originally , the psycho- 
^ legist saw his jole as the scientific observation of hinnan behavior. 
... When hypothesis testing .bi^ame paramount, observation was neglected, 
' and even actively di'scouraged by editorial policies of journals, (ibid) 

Th^ canon of parsimony, misinterpreted, has led us into the 
habit of accepting Type II errojrs at every turn, for t^e sake^of 
holdihg Type I errors tin check. There are more things in heaven 
and earth t-h^n are dreamt ot in our hypotheses, and our observa- 
tions should be open toAthem (Cronbach, 1954). (ibid) 

Instead of making generalizatp.on the ruling consideration in 
our research, I suggest that we reverse our priorities. Aij observer 
collecting data in one particular situation is in a position to 
appraise a practice or proposition in that setting, observing 
. effects in context. In trying to describe and account for what 
- ■■ happened, he will give attention to' whatever variables were control- 
led, but he will give equally careful attention to uncontrolled ^ 
conditions,, to personal characteristics, and to events that occujred 
during treatment and measurement. As he goes from situation /Co""^ 
situation, his first task. is to describe and interpret the effect anew 
in each locale, perhaps taking into account factors unique to that 
locale or series of events (cf Geertz, 1973, Chap. 1). (ibid: 124-125.) 

On the other hand,' a purely qualitative approach is not sufficient. This 
is best illustrated by the state of affairs when we began KEEP: Competent 
researchers and professionals were in sharp disagreement over what to do about 
I^^waiian- American underachievem^nt . Clearly their/ qualitative analysis had 
not led to a'' consensus ; the absence of quantitative studies appeared to be 
the major need in an otherwise biiisy and productive field. It is an apprecia- 
tion of both means of knowing that has proved most valuable for us. 



Prop Theory to Pract^ice: A Missing Link 

A colleague visited us and a^ked why we were not pursuing the idea of 
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using group/team work in order to capitalize on the high affiliation motivation 

« 

of Hawaiian-Americans. This idea had ^been prominently featured in our earlier 
research (Gallimore, 1972; Gallimore, 1974; Gallimore, Boggs, & Jordan, 
1974), and he Expected to see in KEEP classrooms some clear reflection of- the 
te'amwork/af filiation hypothesis. In fact, there was; then again, there was not. 
The problem was to e^^ain to our colleague ^the long and winding road between 
theoretical abstractiod and effective practice. 

His reaction illustrated an important point. "When asked, he could not ' , 
specify the observable outcomes he had expected t;he teamwork/affiliation hypo-' 
thesis would yield. ^He accepted our argument than tha^ use of learning centers ^' 
(five to six children working at tables) was one form, but he (slearly was not 
impressed since such a practice is coiflmon to many schools in communities where 
there are no Hawaiian-American affiliators. He was looking for something a 
bit more unique, something to get .enthusiastic about. 

In our expi^rience, hypotheses such as the one our visitor thought had 
merit, are mcJrely points to begin classroom research fjand development. By the 
'time an effective and workable derivative has been devised, it is often no 
longer recognizable as the offspring of the original idea. The reason is the 
Surplus expectations that many appealing hypotheses imply, .but are' not explicitly 
stated or even understood by the innovator or the hypothesis maker. 

Sarason (1971) presents an, excellent exam^ple of this point in his des- 
cription of the history of the New Math reform in a single scj^ool district . 
The advocates of the New Math intended that fundamental changes would be made 
in the nature of . student-teacher relationships, but these goals were never 
explicitly stated nor actively pursued. Instead, effort and attention wer^ 
directed to" creating New Math curriculum materials and persuading school 
districts to adopt them. He refers to New Math and other innovations, but he 
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coiad just as well have included the team work/affiliation hypothesis: 

: ^"^e goals *of changfig the outcomes ^ught, surely are not to^see 
if it is i/ossible to substitute one set of books for another, change 
th^ racial composition of a class or a school, or have children read . 
or listen to black or Mexican history--thdse possibilities are r«,la-^^ 
itively easy to realize, and I have seen them realized in- preqlsely ' *^ ' 
the same way as in the case of new maith, with precisely the same out- 
c,^'^ bbme: the more things change the more th^y remain the s^e, . . 
.\7 Realizing these types of possibilities simply begs the question 
or their intended consequences , and in these as well as in other ^ 
instances the. intended 'consequences— the basic goals and outcomes— ; > 
always intended a change in the relationshipis among those who are* ' 
, In or related to the school setting. But these intendled consequences 

are rarely stated clearly, if at all, -^iftd as a result^^ia means to a . . 
r ' goal becomes the goal itself , or ibbed^ines t|ie misleading criterion 
for judging change. Thus; we -have tiiie new math, but we do not have 
those changes in how teachers and children relate to each other 
that are nepessary if both are to enjoy, ^sist in, •and productively , 
utilize Intellectual and interpersonal^^gj^eriences--and if thesB ^ , 
are riot among the! intended Consequences , then we must opnclude 
that the -Curriculum reformers' have been quite. ,success|lal in acM 
ihg their go^l of substituting one -set of books for another. '(Sarason, 
1971: 48)^ , . ' : 



^ Many^i^f our visitors (critics) have been disappointed at the l^ck^of^r ' 
.apparent connect;ifh betweem Hawaiian cultural st^^lea and KEEP, classr^ 
. We' early fqjund that an insistence and focus on such cbntiections led to ; ; . 
precisely the same limiting outcomes described by Saras on .^^^^ & ' 

Tharp, ^Technical ^Report #2). Cultirfal ^^^ct a place to begin^ 

but the real work^tarts with the transformation of an appealing idea in^o a 
program component that achieves both implicit and explicit expectation^^ / 
^ In the example of^.the team work/af filiation hypothefsis, the goal/for-; \. 
incorporating suc^ practices would have^ the implicit end of increasing learning, 
not merely •substituting .qne f o,rm of clasropm organization, for another . Main- 
talning a focufe on the real goal leads to steady revision of means,' and those 
.means, iff they are subordinated to tjae goal,' emerge looking very different .from . 

>7hen th^y began. ^ ^ 

Of course, the same problem occup^n efforts to translate into classroom 
practice an appealing change whatever the source—Hawaiian culture,- research 

■ ■ . lu 

• • \ 
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jtjurnals,. university critics, informed laymen, personal imagination. We have 

been ourselves surprised that scientific psychology sources are no less dif- 

' ■ ■ • 

ficult to exploit • ^ , • 

•'> . ^ 

Sarason argues^ that the tendency to leave unstated all^ the intended con- 



sequences pf an innovation is a function o# a larger problem th^t troubles all 

institutions, not just jschopls. ^ . /f| 

' The theory or problem of change "^is^ not in the focus of their 
thinking (school critics and reformers) ... It is not t^at these ' 
people are anti-theoretical or untheorefsi^l,, because mant^of them 
are quite sophisticated as. to the theoretical bases for what ^hould 
' or ought to be\^ ^What their th'eories fail to do is to face the pro- 
blem of how one gets to one' s., goals. ... .Vihis is far from being ^ 
'practical! problem (in the sense of-^how one 'eagineers\ <!:hange) 
but rather we are dealing' with a theoretical pro/blem involving not 
means and ends, but a continuous process. That reality gtubbomly • 
ref uses i to conform to pux theories and categories of thought is 
what h^^^caused so much grief. (1971: 21-) ' - 

Why is there frequently underestimation of how long, it takes 
to initiate the change process — -an underestimation that can. arouse • 
such feelings of angej: or discouragement that it may result in 
aborting the process or in enveloping it in an atmctsphere inimical 
to the intended outcome; why is the estimation of time necessary to 
achieve intended outcomes usually a gross underestimation ? (1971: 60) 

Social Science Theory and Method 

' / ■ . 

Our five years of research and operational responsibility are consistent 
with Saraaon's' analysis. Achieving goals is a great deal more difficult than 
creating them. There has been one constant in^^lj.is'process : 't>e unfailing 
and inmiediate contribution to the means-ends proce^ of the scientific dis- 
cipline — methods of social science ipi general, and psychology in particular. 
The notion that it i^ the methods and not the theories of social science that, 
Stand the test of ti,pnt4 has bee^^receritly suggested by Campbell (1973) and 

i .. . 

Cronbach (1975). Certainly the KEEP experience coi^irms • i:he i^elatively greater 
value of methods. The problem with the t^heories we have already implied in 
ovnc discussion of higher order interactions: There is an enormous and dyiTamic 



universe of situational and behavioral variables in a given setting that tend 



to- invalidarte tjje. static empirical generalizations of social'^scie'nce. Although 
he is pessimistic that science can develop "enduring systematic theories about 
man in^ociety,"'Cronbach suggests that systematic inquiry, cai| make two contri- 
butions. "Ohe reason^Vle aspiration is to assess local events accurately, to 
improve short-run control (Glass, 1972), The, other reasonable aspiration is 
to develop explanatory concepts, concepts that will help people use their 

heads." (Cronbach, 1975: 126) ^ ^ 

We are thereby returned to our first, original goal: to build KEEP as a 
permanent problem -solving resouye , one which can race after the changing, 
confusing wprld, achieving local (Hawaiian) understanding, securing control ^'f or 

; •'• . ■ . • ; ' y . ■)■ 

.perhaps a decade. at a time, and^helping: people to use their heads, *. 

Major-Lines of Investigation 

■ mr' - ^ ; • 

Four major lines of research were each separately organized and initiated 

■ i ■ ' ■ " ■ / - ' 

at different points in time: student industriousness , linguistics^, reading, 
and training/consultation. Interweaving occurred in various ways: For example 
after two years, the linguistic research had produced two measures of dialect 
fluency' (standard and nonstandard) which becatae important elements in our study 
of reading prc^lems. Earlier, these two lines of york were essentially inde- 
pendent. Gf course, at the beginning, we anticipated our various efforts would 
eventually intertwins^^^ but no special effort was made to injpose an overreaching 
or integrated theoretical net. * . . 

* , Appended to this report are a --Complete list of Technical Reports and Work- 
ing Papers, and a list of 34 major KEEP findings, briefly stated. 
Student Indus trdous'ness " ' < v.-. 

The conceptfion of KEEP followed on the heels of the national development / 

^ ; • • , . ■ \ 

of educatiofi behavior analysis' (Tharp & Wetzel , 1969) . In Hawaii, the work 
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in Leeward Oahu Schools had begun to explgre and develop applications of behavior 
analysis to the particular ^cultural patt:ems\olf Hawaiian-Americans (Gallimore 
& Howard, 1968; MacDonald & Gallimore, 1971)^ The enq)hasis in both of 
these developments was upon increasing the amoimt o;£.. time students spent oh 
classroom assignments — what a senior Hawaii educator described as "industrious- 



liess*, a term we have borrowed. a 



The complaint was widely voiced in 1970 that many*Is\mid children did \^ 
poorly in school because they were riot sufficiently industrious (Tharp & 



Gallimore, Technical Report #1). Earlier efforts to increase student work time* 
showed promise; for example, MacDonald and Gallimore (1971) provided special 



training for teachers which appeared tb increase student industriousness , an^ 
turn, acad^mie^achievement. For th/e most par-t these efforts were remedial. 



involving older children who were .al^ady many grade levels behind in 
achievement. 

KEEP began promoting industriousness from the beginning of kindergarten. 

The' question was: -^If students from the beginning of their school/ experfence 

I ) ' ' ' 

are systematically trained and encouraged to be industrious, what academic 

benefits will be gained? t 

The initial strategy involved training KEEP staff in use of industriousness 

enhancement techniques of previously demonstrated value, for example, use of 

positive reinforcement. Careful monitoring of both teacher and classroom.be- 

havior was carried on, as well as daily observation of child industriousness 

(see Technical Reports^//6, #19, and //2A). By continuous monitoring we hoped, 

to achieve what Cook and Campbell (in press) have described as construct 

valiMty. That is, construct validity depends upon. a proper translation of 

theory into either independent or dependent variables. In the case of student 

industriousness'^ it was absolutely essential to assess the eff e(?ts o^f staff 
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training; rates of teacher use of behavior ^management te^chniques had to go . 

fir \ 

* ■ » . ^ 

above baseline and remain there. For a more complete, r^cview of industrious- 
ness Research see Tharp and Gallimore (Technical Report #60). 
Linguistics ' || ^ * ^ 

When KEEP began, the debate raged hotly over the role of nonstandard dia- 
lects in educational underachieVement . In Hawaii, a similar controversy em-: 




s 



broi/lea/ the 'Island dialect commonly called i)idgin. Our strategy in this case. 



( 



was strictly empirical; it was clear that much of the debate was theoretical 
or moral in substance, with neither side of the argtiment in possession of many 
fact's.' We .began .two lines of study. .First, work was focused on development^ 
of reliable and valid means of assessing staudard and nonstandard dialect per- ** 
formance levels.' These efforts resulted in twp instruments, which are described 
in Technical Reports //15 and //28. Concurrently, a more focused series of studie 
explored the acquisition and use by Island Irhildren of particular grammatical 
features. The purpose of the latter was to provide a fine-grained analysis of 
factors affecting dialect use and competence. ^ complete review^^bf the language 
research is presented in Gallimore and Tharp (Technical Report #59). 
Re d in g 

A phased, multimethod research strategy wds adopted. We assumed that the 
magnitude and complexity of « the reading problem was best attacked from several . 
/directions. We have experimented both in the sense' of carefully observed 
/changes in the school' s 'reading program, and in the use of short-term exper^ 
mexital studies. . . ' , , 

Thesjsfee^d's reading program and the research were organized in successive | 
^^^^^pbas^. The first year we sought to establish a baseline of achievemenj 
^vels obtained with a standard basal reader program under ^ the special con- . 
Editions at KEEP, mth the emphasis on enhancing lindustriDusness in operation, 

. ■ X ; . ■ . 
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we sought to determipe if .increases in student effort coupled with a well run, 
but standard, reading program would improve achievement levels.^ We concluded • 
that industriousness was necessary but not sufficient (see Tehcnical Report y/26), 
The second yeaj a series of experiments were conducted which tested the hypo- 
theses that were derived' from the first year of work. The results of this 

/ . 

work are summarized by Au in Technical Report #57. 

Training/Consultation 

* '• , * " ' 

,u Staff-training studies were intierwoven with the industriousness research, 

\ ' ■ - ' ^ ^- 

. . •) • • 

since much of the latter depended upon teacher acquisition of new skills. , Two 

approaches have been employed: (1) closely supervised case studies of teachers^ 
in training, with quantitative data taken on\eacher and student classroom be- 
havior; and (2) component-process studies involving both KEEP staff and public 
school teachers. The latter have been simultaneously evaluations of various 
forms of export -consultation to cooperating public schools. 

Explorations of approach'es to exportation have included variations in site 

' - . ~ - 

of consultation (inaccessable rural to nearby urban) , styles of consultation 

(unfocused troubleshooting to hijghly structured), and problem area ^from student 

industriousness to teacning reading)^. 

We have followed Tharp^s (J975) distinction between training and consulta- 

tion in selection of depende^nt variables. Briefly, in instances where the be- 

hatrior to be trained has been independently evaluated, data are taken on the 



targets of training. In consultation, data are taken on. both those in training 
or under supervision, and ot> those individuals the trainee is to be taught to 
Jielp. Thus, in a training/s tudy , we might assess teacher praise rate; in a 
consultation, we might add a direct observation measure of student work rates. 
Tanaka-Matsumi has suiranariz.^S this reseaAih (Technical Rep^rT*//58) . , 



66-18' 



Additional Areas of KEEP Research 

In additipn to these ^ main jareas of resjearch, there are a variety of efforts 

that are in progress or have been completed at KEEP. Those completed are 

described in more detail in Technical Reports and Working Papers^ references 

to which will be provided with ^the ..brief summaries that follow. 

Culture and Family Res^||rch ' ^' ^ » 

A major new line ofjres^arch on family and cultural factors was begun at 

KEEP in 1975. One report is now^a^pil^^ (Jordan, Technical Report #61).* 

Jordan analyzed ihe content of KEEP mother-child interactions. Mothers and 

their children were given ,tasks which had to be completed by cdoperative work. 

Amounts of verbal, predominantly verbal, predominantly nonverbltl, and nonverbal 

directions by the mother were measured. The results showed a significant posi- 

\^ ^ " ^- - ' ^ ' 

tive correlation between amount of verbal and predominantly verbal direc^^ns 

and children's IQ scores as entering kindergarteners. A comparison group of 

mainland mothers used more verbal instructions than did KEEP mothers. 

Classropm ethnographic studies are in progress. The topics coveted in- 
clude child jole- taking and peer teaching, This effort is the first long-term 
KEEP effort to do fine-grained ethnographic observation studies of classroom 
activities. It is anticipated that ^thi\^ine .of wprk will provide a continuing 
source of new hypotheses, as well as a brpader view of child behavior than our 
systematic oti^ser^ation studies (for example^ Technical Reports #6 and #19). 

Also in progress is a two-pronged effort to increas^ our understanding of 
the family life of KEEP children. This effort— the KEEP Family Research Program 
(PRP) — extends analysis of Hawaiian child behavior to a second major source of 
influence. The overall purpose of the FRP is to determine the extent to which 
KEEP school performance is correlated with home factors. Research to date has 




66-19 



clearly shown substantial variability .among the children who enter KEEP at age 
five. Some of the differences can be attributed to the capacity of the child. 
Others seem more likely a function of experience. For example, the children 
vary widely in language fluency, which bas been identified as a major factor 
in reading acquisition; the children's home en^vironments differ as well. 

Two ^ethods of study have"^' been adopted. Ffrst, an' extensive, interview . 
schedule was dev^oped. Ihis procedure covert the major features of family 
life, including questions .Regarding child behavior and management, family 
structure, organization, and composition, income and residential change data, 
and so fort^. ^ 

A second independent source of information is 'the field obseryatit>n pro- 
ject (FOP). The FOP Is gathering data on a sample of KEEP children during 
their home and outdoor .activities after the KEEP bus brings them home in the 

■ I 

afternoon. KEEP staff visit the homes and observe- the child, his caretakers 
(if any), and the social settings the child is in. The topics of current 
observational focus include a number potentially related to classroom 
performance: (1) child's tasjks and activities , (2) social group settings and 
characteristics , (3) language use , (4) home teaching , (5) disciplining or 
compliance , (6) child caretaking , and (7) unobtrusiveness of observer. 

At this point, the pOp is a hypothesis-generating study . While there are 
several issues to be examined that were raised by earlier work, the major 
thrust at this time is exploratory. Our aim is to narrow down the number of 

family and Home variables and develop testable hypot^heses. Subsequent work 

v^t*" .... 

will be more directed, and based on .a fnore carefully drat>n picture of natural 
settings , language use, activities, arrd so forth. - 
Outcome Research ' 

. ■ \ ■ ■ ' .• ' 

To verify the assumption that Vegea'rch activities do not injterfere with 
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the no.rmal instruction given' to KEEP students, each class's educational, and 
intellectual achievement; is assessed, and comparisons made with other classes 
in Hawaii. Technical Report 7/36 discusses the results of standardized IQ and 
achievement tests given , to KEEP's Class I, II, and JII, and to two comparison 
schools in Kalihi, to a school in a rural area of a neighbor island, and to a 

school in a middle- class, suburb of Honolulu. The results indicate that KEEP 

■ ■ . r . V ' A ^ ■ 

is meeting its educational responsibilities for its students in terms of 



academic readiness and genral intellectual achievement, both in^^oinparison 
to national norms and* to the relativiely comparable schools in Kalihi. In 
terms of reading skills, KEEP students are reading at the level of schools 
they would have normally attended, although the reading performance of all 
schools tested is bel(?w national norms. > 

Technical Reports #5 and #40 present more detailed^pre- and posttest re^ 
suits for the kindergarten years of KEEP Classes I and II, respectively. Re- 
su Its are presented for the Wechsler Preschool and -Primary Scale of Intelli- 
gence (WPPSI) , the Metropolitan Readiness Test (MRT) , and the Standard English 

* * ' > - ■ 

Repetition Test (SERT) . Significant correlates of the three measures and 
selected SES variables are presented. These data suggest there is consider- 
able variability within KEEP classes, bottr in terms of entering skill and 
achievement levels ,. changes over time, and family background. 

Efforts to describe and interpret the extensive within-group .variability 
are. in progress. One approach is to' categorize students on the basis of 
kindergarten entry status, and examine their progress across time. Another 

approach is theuse of multivariate analysis, (Technical Report #54). 

. ■ ■ is- ^ " ' 

Cooperative Research Effor"^s , * 

^rom'time to time, KEEP has cooperated wfth investigators from other 
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Institutions. The major and continuint cooperative^ arrangement is with the 

Sociobehavioral Research Group, MRRC, at the University of California, Los 

Angeles. Since 1971, two members of the Sociobehavioral Group (Professors 

Price-Williams and Edgerton) have operated ;a' research project in the Hookena 

School area. Hookena School is the site of 'a major KEEP consultation res'earch 

activity; and provides a point of contact 'between KEEP and the UCLA proj'^ct. >^ 

There are two int^^rlocking components of the UCLA-Hookena Project, one 

ethnographic and anthropological, and the 'bther cognitive and 4.inguistic. . 

Through informal channels, workers in the two projects have provided information 

I, . .. 

exchange. More formal reports of the UCLA-Hookena fProject are in preparation 

and will be available .at a later date. 

* ■' ^ 

Cooperation with , researchers from the Department of Psychology, at the 

^ ^- ' ^ " ■ c ■ ■ ■ ' ' ■ • • ' ■ . ^ 

/ University of Hawaii has also produced results valuable for KEEP. Dr. Wiliram o 
Higa assessed the contribution of self-instruction in a cognitive training 
package; the goal of the package was to train children to use speech as a 
m^diator^pf overt behavior; Higa compared self-instructional training to a - 
direct training procedure; There were no differences between posctraining test 
performance, of im'pulsive children in the self- instruction and dir:e,ct tr«titiing , 
groups; in addi^i^onthere^was^no correlation between appropriate "^!|°^ self- 
instructions and task performance (see Technica], Report ^/63). ^. 
' : Another University of Hawaii researcher. Dr. David Lam, agsesQed the effect- 
iveness of different thild-traiillng methotis. Three distinct procedures were. ^ . 
compared: (1) .simple .instructions, (2) '^flrnple insli^tionS plus peer modeling, 
and (3) simple instructions plu^ modeling plus, etiild rehearsal. A fourth group - 
served as pl^ebo* controls . A Second \ariablie/was expectancy of |-einf orceme^t * 
Children were taught basic readiness skills, such as following direcffeions, , 
answering questions, and so forth.^ *Each child , was. assigned to one of the training 
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conditiotis; a fourth group of children was assigned to a control group. There 
were a. number of significant findings; wfille there were no darg^ differences 
across rae training conditions, children with an expectancy qf rewar^ who re- 
.ceived^inst ructions, peer modeling, and rehearsal training learned the most 
(Lam, 1975). . * , . / * ' ' - \ ' 

As a UCLA p redo ct oral student, Dr.^Toni Falbo (now at Wake Forest) studi-ed 
the preferences KEEP kindergarteners haiV^for explaining success and failure 
outcomes. The data indicated awareness of the causal ^nature of achievement in 
kindergarten-aged children and considerable agreement between teacher and student 
responses (1973). * f . ^ . ' \ > 

A second study '-by Dr. Fialbo involvl^d 48 KEEP kindergarteners. Th^se data 
indicated that the children's explanations of achievement outcomes were related 
to IQ scores, income, and mother's education, but not^birth order.- The study 
showed that kindergarten-aged children have forced the connection between achieve- 
ment causes and achievement outcomes, and that the attributional patterns as- 
sociated with high versds low achievement can already be found among kindergar-' 
teners (1975). ' * ^ ^ 

In a related but independent investigation. Dr. Mark Stephens of Pur<Jue 
, University compared KEEP and Mainland U*S. children on measures of expe^ancies, 



of internal versus external control of reinforcement. Preliminary analyses 
suggest the kEEP data failed to .replicate widely reported findifigs from U.S. v 
Mainland populations. Reconciling Stephens ' data with Falbo's results must 
await .final analyses of the Stephens data. ^ * 

Future Directions . ' 

It is premature to attempt to a summary of our work in 1975-76; the concluding 
data are not in. However, our own reading of the data summarized in this report 
has \ led us into the following activities, which we anticipate will be the, foci 



1. Future inquiry inta ianguage ana cognLcion, ana mosz eepBciauLy, 
, ■ their interrelationships, / - 

The development of inatructlonal programs for fostering KEEP 
Ten's ability to thlnk^ linguistically . , ' 

\{, ■ . 3." The 'development of. a revised, detailed reading curriculxim. 

' • ■ • ♦ 

4. Replication of reading program results with additional KEEP 
' classes, and/ in public schooLs. ^ . 

5. Further research into the naturally-occurring teaching and learning 
, interactions of KEfiP children. , 

6. Fufc-t;her research in methods' for motivating DOE teachers to adopt 
KEEP findings. • " . 

- 7. Follow-up studies of KEEP children returning to public schools in 
fourth gr^de\ . \ / ^ 
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Major KEEP Findings 
1971 1975 ' 



Findings , ) • Technical Reporti^ 

» ♦ . . , 

1. keep's program tb train its own staff in motivating childrea "'6, 7, 8, 9, ll, 1 
has been extremely successful., 24, 41, 56, 58 

2. keep's children are, on the average, 20% more industrious 55, 60 
than comparison schools. 

. ■ * ■ 

3. One contributing factor is providing them with success ex- 56," 60 
pferiences^ and a rich diet of teacher pr^se. When compared 
to other schools, locally and on the mainland, KEEP teachers 
praise children 3 times as mpch and scold them less. * 

4. KEEP children have the same average IQ scpr^ as national 5, 36, 40. 
norms by the time they have completed tKe kindergarten /year 
at KEEP, although they are lower than the norms when they 
begin kindergarten, 

. / ■ 

5: keep's children are handicapped in learning mathematics by 44, 60, ^2 
their difficulties "in reading and understanding word prob- 
lems^ Otherwise, they could probably perform at national 
norms in mathematics. ' 

6. Even when KEEP children are very industrious, they do not 26, 36, 42,. 43,^ 
achieve grade^level reading proficiency using available, 60 
standard curricula. 




7. Reading-readiness programs iij kindergarten are necessary 34, 57 
and valuable. 



8'. A reading curriculum, for KEEP children should not begin with' 26, 36, ^42, 43^ . 
phonics iJnor be primarily based on "phonics*^ ^ [■ 50, 57. 

^ ' " ■ ' V ' ■ " 

9. Even though many KEEP children do not use Standard English 15, 29, 59 ^ 

in everyday^ speech, they still understand it. 
« ' 

10. There is a high correlation between skill in Standard 59 
English and skill In Hawaiian Islands Creole, as measured 

hy KEEP tests. Relative to their classmates, there are 
very few, children who are good in one dialect and poor in 
the other* ' 

11. Being a pidgin spdaker does not in Itself handicap a child' 54, 59 
in learning to read, even when the instruction is in 
Standard English. / •* 
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12. Skill in Standard Eifiglish and Hawaiian Isl^ands Creole both ,26, 54. 
are related to reading achievement, but Standard English 

skill 'is sightly more important. 

13. Verbal IQ, is more important in learning to read than skill 54 
•in either Sta^dard English or Hawaiian Islands Creole. 

14. Hawaiian Islands Creole English (pidgin) spaafcers show 15, 59 
steady improvement in Standard English speech skills from 

ages fiVe.to nine. This imprpvement occurs in rural, 
' suburban, and urban schools. 

• ' ' ' , • ' - . 

1^. The grammatical jfe^tures of Standard English that are diffi- 59 
. cult for Greole-speaking children arp fhe' same ones that are 
. troublesome for Mainland Caucasian children. An investiga- 
- tion ih progress indicates that this also is true for Indian, 
. Black, Chinese, Japa^iese, Mexican imm^^^ Korean, Filipino, . ^ 
'and' Hawaiian-Americans living, in California. . . 

16.. Hawaiian Creole speakers show steady improvement in Hawaiian 59 
• Creole from ages five to seven, just as th^y show steady 
improvement 'in Standard English. There is no evidence of a 
decline in Crdole-speaking ability as' the result of attend- 
ing school. . 
, ■ ' •> ^ 

17, By age nine, Creole speakers are able to use Standard English. 59 
This occuts without special drill or programs. 

is. It is probably true that increasing the number, of oral Ian- 43, 57, 59 
guage opportunities and actfiLvities in ^^:e«eral is more likely 

to affect academic achievement, than Mr ill or special classes ^ 4 
focused on Standard English. |lesearch and development will 

be needed to define and train teacher classroom skills "that v 

foster oral language deyelo^pment * . . ^ ^ 

19. Social environment strongly affects oral language per for- 30, 5 
/ mance. Thiis, Creole-speaking children will not always ^ • 

show the Standard English competence they have in tes^^^_^' 
situations. i 

20. In the kindergarten qlassroom, children interact and speak 16 
' to others in patterns that have nothing to do with' either 

Standard English or Hawaiian Creole ability. There is no 
tendency for kindergarten children to group' themselves in 
terms, of the dialect they use. / 

21. Kindergarten verbal ability scorfes are higher foE children 65 
who attended preschool, but there is no difference on any . 
measure Vhen the children complete first grade. KEEP 
children Who did not attend preschool perform the same on 
first grade* reading achieveihent tests as ,those that did 
attend. 
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22. The best predictors of first grade readinjg achievement are 59 - 
general verbal ability and reading-readinees scores. ^ 

23. The clusters of intellectual abilities in the KEEP popula- .54 " 
tidn are identical to previous studies in other education- 

ally disadvantaged populations. ^ 
... .\ ^ 

24. Family .background is strongly relat.ed to scliool achievement* 5, 46^61 

25. Hawaiian'^ mothers use a (different teaching style than U,S. 61 
Mainland mothers; they use more demonstration than verbal ^ 
• ijfnst ructions. For KEEP children, school. achievement is 
related to mother use of verbal directions. 

26. KEEP students do as well or better than appropriate com- ^^36y 60 
• parison schools which do not carry on extensive research. - 

Hawaiian- American children in maTiy schools, including RfiEP, 
perform below grade level in basic academic areas. < 



.27. KEEP students show large and significant .increases during 5, 26, 36, 40, 
kindergarten in school and reading readiness. They do not 42, 57 
show, increases of that magnitude ih reading achievement in 
• , first grade. ; ^ ■ , ^ 

28. About 10-15% of KEEP children hav^ serious intellectual/ . KEEl^ recotds 
learning* def iciences that require special education. ^ ' 

29. KEEP has devised effective methods for training public 33, 52 
school teachers to motivate their pupils, when those . " 
teachers are interested in leaming^how. * ; 

30. At least half o;f our teachers are' also competent trainers 27, 33, 51, 521yi 
and consultants to DOE teachers* . ' ' . 58 'a^-. . 

31. Effective cooperation Has been maintained between KEEP and 27, 33, 51, 52, 
the DOE Board of^ Education, the Superintendents, prlnci- 58 

pals, and thosfe teachers, with whom we have worked. . ^ 

' • ^ . ■ , , ; V. — 

32. We have successfully exported .to DOE teachers the following: 27, 33, 51, 52, 
management techniques, improved classroom organization, and 58 
curriculum materials and techniques in math and reading. . 

33. We have intensively studied two basic forms of Sporting: ^ working paper 
vforkshops and continuing resource consultation. Both have 

been effective in meeting their goals. There is no real 
difference in cost ^ Both are labor-intensive. 

34. To successfully influence public education in behalf of 
Hawaiiany>^ildren, it 'is necessary that individual teachers " - . 
be motivated to learn new skills. Further research is \ . 
needed to find ways to enhance teachers^ motivation. to. 

participate in KEEP training. 



